A Novel Evaluation Model for Assessing ChatGPT on Otolaryngology-Head and Neck Surgery Certification Examinations: Performance Study.

BACKGROUND: ChatGPT is among the most popular large language models (LLMs), exhibiting proficiency in various standardized tests, including multiple-choice medical board examinations. However, its performance on otolaryngology-head and neck surgery (OHNS) certification examinations and open-ended medical board certification examinations has not been reported. OBJECTIVE: We aimed to evaluate the performance of ChatGPT on OHNS board examinations and propose a novel method to assess an AI model's performance on open-ended medical board examination questions. METHODS: Twenty-one open-ended questions were adopted from the Royal College of Physicians and Surgeons of Canada's sample examination to query ChatGPT on April 11, 2023, with and without prompts. A new model, named Concordance, Validity, Safety, Competency (CVSC), was developed to evaluate its performance. RESULTS: In an open-ended question assessment, ChatGPT achieved a passing mark (an average of 75% across 3 trials) in the attempts and demonstrated higher accuracy with prompts. The model demonstrated high concordance (92.06%) and satisfactory validity. While demonstrating considerable consistency in regenerating answers, it often provided only partially correct responses. Notably, concerning features such as hallucinations and self-conflicting answers were observed. CONCLUSIONS: ChatGPT achieved a passing score in the sample examination and demonstrated the potential to pass the OHNS certification examination of the Royal College of Physicians and Surgeons of Canada. Some concerns remain due to its hallucinations, which could pose risks to patient safety. Further adjustments are necessary to yield safer and more accurate answers for clinical implementation.

Knowledge, Attitude, and Practice of E-Cigarettes of Adolescents and Adults in Saudi Arabia: A Cross-Sectional Study.

E-cigarettes have gained enormous popularity, and their use has increased drastically worldwide. However, little is known regarding adolescents' and adults' knowledge, attitudes, and practices in Saudi Arabia. We conducted a cross-sectional study using a self-administered online-modified WHO GATS questionnaire on a convenience sample approach. Data were collected between January and March 2021 after the alleviation of COVID-19 lockdown measures in Saudi Arabia. Univariate and multivariate regression models were developed to identify independent factors associated with knowledge, attitude, and practice. Our sample (1335) had a mean age of 26.45 ± 10.5 years; nearly half of the participants had poor knowledge about e-cigarettes. The usage and positive attitude were reported by 18.6% and 19.4%, respectively. Around 43.5% of e-cigarette users reported starting or increased use during the COVID-19 pandemic, while 9.5% of participants would recommend it to others. Logistic regressions showed that older participants were more likely to have poor knowledge (OR = 1.02, 95% C.I. = 1.01-1.03) and positive attitudes (OR = 0.98, 95% C.I. = 0.91-0.96). Male participants and smokers (OR = 3.0, 95% C.I. = 2.3-3.8) were more likely to have a positive attitude. However, younger participants were less likely to go for e-cigarettes (OR = 0.95, 95% C.I. = 0.93-0.97), while males (OR = 2.53, 95% C.I. = 1.65-3.86) and smokers (OR = 4.63, 95% C.I. = 3.47-6.18) were more likely to use them. This study indicated a high level of poor knowledge about e-cigarettes. A considerable proportion of participants reported usage and a positive attitude towards them. Older age, male gender, and being a smoker were the main elicited predictors for e-cigarette use.

Comparison of cochlear duct length between the Saudi and non-Saudi populations.

BACKGROUND: There are no data on cochlear duct lengths (CDL) among Middle East populations. OBJECTIVES: The main aims of this study were to estimate the average CDL in the Saudi population and to compare it with the reported CDL in other regions/ethnic groups outside the Middle East. DESIGN: Retrospective study. SETTING: Tertiary otolaryngology head and neck surgery center. SUBJECTS AND METHODS: Temporal bone CT scans were reviewed to determine CDL. We excluded any CT scan of an ear with a congenital inner ear anomaly or acquired pathology. MAIN OUTCOME MEASURES: CDL. SAMPLE SIZE: 441 temporal bone CT scans. RESULTS: The overall CDL mean was 31.9 mm (range 20.3-37.7 mm). The cochleae of males was significantly longer than of females and cochleae from the left side were significantly longer than of the right side. No significant difference was found between children and adults. Inter-study comparison revealed a significant difference in CDL between the Saudi population in our study and European and Australian studies, but not between the present study and North American studies. CONCLUSIONS: The CDL differed significantly according to side of the cochlea and sex, but not by age. Geographically and ethnically, the mean CDL for Saudis was significantly different from the CDL of subjects of some ethnic backgrounds, but not others. Due to this diversity, we recommend that the CDL be measured before cochlear implant surgery. LIMITATIONS: All the measurements were done by one person, and the subjects' physical measurements, such as height or head circumference, were not included. CONFLICT OF INTEREST: None.

Assessing correlation between students perception of the learning environment and their academic performance.

OBJECTIVE: To assess the association between the learning environment and academic performance at medical colleges. METHODS: The cross-sectional study was conducted in four medical colleges in 2014 in Riyadh, Saudi Arabia. Online questionnaire was sent to final year medical students. It included demographic profile, the last Grade Point Average, and the Dundee Ready Education Environment Measure. Data was analysed using SPSS 17. RESULTS: Of the 423 students who were sent the online form, 261(61.7%) responded and among them 193 (45.6%) questionnaires had been fully filled and were included in the analysis. Mean Dundee Ready Education Environment Measure score was 117.9±27; higher for females (p=0.019). Correlation coefficient 'R' was 0.29 (p<0.001). As the perception of learning environment increased from "Poor", "Plenty of Problems", "More Positive than Negative" to "Excellent", the mean GPA increased gradually (p=0.0006). Perception of learning environment as "More Positive than Negative" and "Excellent" increased the mean GPA by 0.38 (95% confidence interval: 0.19 - 0.56) compared to "Poor", "Plenty of Problems" on multivariable analysis. CONCLUSIONS: Low, yet positive correlation between perception about learning environment and academic performance in the form of GPA indicated that improvement in the learning environment may enhance the academic performance of medical students.

Reducing anxiety in preoperative patients: a systematic review.

There are still uncertainties regarding the appropriateness and effectiveness of various modes of delivering preoperative education. Hence, this systematic review was conducted to investigate the effectiveness of various preoperative educational interventions in reducing preoperative anxiety. Fourteen interventional trials (12 randomised controlled trials and two pre/post test trials) involving a total of 1752 participants were included in the review. Four studies used audiovisual; two trials used visual; two trials used multimedia-supported education; one trial used a website; two trials involved verbal education delivered by a psychologist or a nurse facilitator coupled with leaflets; and one trial involved informational leaflets only. Eight of the 14 trials demonstrated that preoperative education intervention reduced preoperative anxiety significantly (P<0.05). It can be concluded that preoperative education interventions are promising in reducing preoperative anxiety in patients scheduled for surgical procedures.